A NEW METHOD FOR CONSTRUCTING INVARIANT SUBSPACES 
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Abstract: The method of compatible sequences is introduced in order to produce non- 
trivial (closed) invariant subspaces of (bounded linear) operators. Also a topological tool 
is used which is new in the search of invariant subspaces: the extraction of continuous 
selections of lower semicontinuous set valued functions. The advantage of this method over 
previously known methods is that if an operator acts on a reflexive Banach space then it 
has a non-trivial invariant subspace if and only if there exist compatible sequences (their 
definition refers to a fixed operator). Using compatible sequences a result of Aronszajn- 
Smith is proved for reflexive Banach spaces. Also it is shown that if X be a reflexive Banach 
space, T G ^{X), and A is any closed ball of X, then either there exists v & A such that 
Tv = 0, or there exists v & A such that SpanOrbT(Tf) is a non-trivial invariant subspace 
of T, or A C Spa^ {T'^Xi : £ G N, 1 < A; < for every (x„)„ G A^. 

1. Motivation 

Let X be a Banach space (always of dimension larger than 1) and T & C {X) (i.e. T : 
X ^ A is a (bounded linear) operator). A (closed) subspace F of A is called an invariant 
subspace of T if T{Y) C Y. Also Y is called non-trivial if {0} ^ F ^ A. The Invariant 
subspace problem asks whether every operator on a complex Hilbert space has a non-trivial 
invariant subspace. This problem has its origins approximately in 1935 when (according 
to [Oj) J. von Neumann proved (unpublished) that every compact operator on a separable 
infinite dimensional complex Hilbert space has a non-trivial invariant subspace, (the proof 
uses the spectral theorem for normal operators, see |12])- Since then the invariant subspace 
problem has motivated enormous literature in operator theory. The books [Sj, jBlJ, ^35^ . 
[TT] . the lecture notes PP and [20], and the survey papers [TH] and |2] are centered around 
the invariant subspace problem. Related open problems and conjectures appear in The 
invariant subspaces appear in a natural way in prediction theory (see A.N. Kolmogorov 
and N. Wiener 02] ), and its interpretation in terms of unitary operators in a Hilbert space. 

Let's recall some basic terminology and elementary facts about invariant subspaces: Let 
A be a Banach space and T G £ (A). The operator T is called non-transitive if it has a non- 
trivial invariant subspace. For x G A\{0} let Orbr(x) = {T"x : n G N U {0}} be the orbit 
of X under T. The closed linear space generated by OrbT(a;), Span OrbT(a;), is a invariant 
subspace of T. The vector x G A\{0} is called non-cyclic for T if SpanOrbT(a;) ^ X. If 
the operator T is non-transitive then it has a non-cyclic vector. Also if A is a non-separable 
Banach space and T is an operator on A then every non-zero vector in A is non-cyclic for 
T, thus T is non-transitive. If A is a finite dimensional (always of dimension larger than 1) 
complex or odd dimensional real Banach space then the Fundamental Theorem of Algebra 
gives that T has a non-zero eigenvector which spans a non-trivial invariant subspace. If X is 
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an even dimensional real Banach space with dimension larger than 2 then by considering its 
complexification it can be proved that every operator T E C {X) has a non-trivial invariant 
subspace. On the rotation by 7r/2 radians does not have non-trivial invariant subspaces. 
If T 7^ and Y := ker (T) ^ {0} then F is a non-trivial (hyper-)invariant subspace of T (i.e. 
SY (ZY for all S G {T}' = {A e C{X) : AT = TA], the commutant of T). If T and 
Y := Ran (T) ^ X then F is a non-trivial hyper-invariant subspace of X. 
The key notion in this article is the notion of compatible sequences: 

Definition 1.1. Let X be a Banach space and T E C (X). Two bounded sequences {xn)nm C 
X and (x*)„eN C X* are called compatible if 

(a) No subsequence of (x„)„ converges weakly to zero. 

(b) No subsequence of (x* )„ converges weakly to zero. 

(c) There exists a sequence (£„)„ of positive numbers converging to zero such that 

(1) \x*mT''xi\ < Em for all I < k < £ < m. 

Remark 1.2. Let X be a reflexive Banach space and T G C{X). T has a non-trivial 
invariant subspace if and only if there exists a pair of compatible sequences. 

Indeed, let (x„)„ and (a;*)^ be compatible sequences as in Definition 11.11 The reflexivity 
of X implies the weak compactness of the closed balls, hence, since the sequences {xn)n and 
(x* )„ are bounded, by the Theorem of Eberlein-Smulian, pass to subsequences of (x„)„ and 
(x*) and relabel to assume that there exists v E X and v* G X* such that converges 
weakly to v and (a;*)„ converges weakly to v*. Notice that ((H) is still valid after the relabeling 
if one passes to the same subsequence of (a;„)„ and (x* )„ before relabeling. Now Hxl < k < i 
and let m ^ oo in (0) to obtain 

(2) v*T^xe = for all 1 < < i. 
Then fix /c G N and let £ — oo in Q to obtain 

(3) v*T^v = for all keN. 

By (a), f 7^ 0. Thus, if Tv = then SpanOrbT(f) is a non-trivial invariant subspace of T. 
If Tv 7^ then Span Orbr(Tf ) is a non-trivial invariant subspace of T (it is non-trivial since 
by © it is contained in the kernel of v*, kerf*, and kerf* ^ X since f * 7^ by (b)). 

On the other hand, if an operator T E C (X) has a non-trivial invariant subspace Y, then 
for every x G y\{0}, the closed linear space generated by OrbT(x) is a non-trivial invariant 
subspace of T, thus there exists a non-zero functional x* G X* such that OrbT(x) C kerx*. 
Hence the sequences (x„)„ and (a;*)„ with Xn = x and x* = x* (for all n) are compatible. 
This finishes the proof of Remark 11.21 

The method that is introduced in the present article, consists of showing how the absence 

of a pair of compatible sequences in some regions A G X and B C X* (cf Claim 1 in the proof 

of Theorem 13. 2|) implies (under the additional assumptions of Theorem 13.21 the operator is 

compact and the reflexive Banach space is over the complex field) that the operator must have 

a non-zero eigenvector. The motivation for introducing the method of compatible sequences 

comes from the equation in line 11 from the end of page 542 of [H]. In this equation a 

quantity of the form x'^T'^Xn is considered for some sequences (x„)„ C X and (x*)„ C X* 

which satisfy (a) and (b) of Definition 11.11 and converge weakly to some non-zero elements 

X E X and x* G X* respectively. In order to conclude that x^T'^Xn converges to x*T^x as 
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n ^ oo, the assumption of the compactness of the operator T is necessary. In order to avoid 
this necessity, information about the behavior of x^T^Xi is needed (i.e. when the indices of 
the sequences and do not necessarily match). 

A similarity of the present method to the one used in |21j is that the Brouwer-Schauder- 
Tychonov's fixed point Theorem plays an important role in the proof. Nevertheless, the 
necessary compactness for the application of the Brouwer-Schauder-Tychonov's Theorem is 
not obtained by the compactness of the operator (as in but instead is obtained from the 
reflexivity of the Banach space (hence convex closed bounded sets with the weak topology 
are compact). The reader may then wonder why the compactness of the operator is still 
assumed in Theorem 13.21 .'' The proof of Theorem 13.21 reveals that under the assumption 
of the compactness of the operator, the function $ defined in (jSI) is lower semicontinuous 
even if the range space X is endowed with the norm topology (nevertheless notice that the 
lower semicontinuity of $ if X is endowed with the weak topology, is sufficient for the proof 
to work!). Thus it is reasonable to ask whether modifications of the proof of Theorem 13.21 
can remove or relax the assumption of the compactness of the operator in the statement of 
Theorem 13.21 

2. Some history 

This section contains some (non-exhaustive) history. Many important directions will not 
be discussed here. For some of these the reader is referred to [T], [2], P, [Hj, [HI, 120], |Mi, 
The history here is organized into five subsections: (A) the Theorem of Aronszajn- 
Smith and some extensions; (B) the Theorem of Lomonosov and some extensions; (C) 
subnormal, hyponormal operators and dual algebras; (D) the method of extremal vectors 
and (E) examples of transitive operators. 

(A) In 1954 N. Aronszajn and K. Smith |B] proved that if X is an infinite dimensional 
complex Banach space and T ^ C {X) is completely continuous then T has a non-trivial 
invariant subspace. A non-linear map is used in the proof: X is assumed without loss of 
generality to be strictly convex and for a finite dimensional subspace Y of X, the "metric 
projection" Py : X ^ Y {a non-necessarily linear map) is defined by Py{x) to be the unique 
y eY which minimizes ||x — ?/'|| for y' eY . 

In 1966 A. Bernstein and A. Robinson [12J proved that if is a complex Hilbert space, 
T E C (H) is a polynomially compact operator (i.e. for some non-zero polynomial p, p{T) is 
compact) then T has a non-trivial invariant subspace. The proof uses non-standard analysis 
as well as techniques similar to |6j. In 1966 P.R. Halmos gave a proof of the same result by 
a similar method but avoiding the non-standard tools, |19j . 

In 1968 W. Arveson and J. Feldman, [7] proved the following: Let if be a Hilbert space, 
and T E C (H) satisfies ||TP„ — P„TP„|| —>■ for some sequence (P„) of orthogonal projection 
operators which converges strongly to the identity operator (such operators are called qua- 
sitriangular; the terminology is due to Halmos). Assume also that the norm closed algebra 
generated by T and 1 contains a non-zero compact operator. Then T has a non-trivial in- 
variant subspace. In 1973 C. Pearcy and N. Salinas proved that if T is a quasitriangular 
operator on a Hilbert space and TZ (T) -the norm closure of the rational functions of T- con- 
tains a non-zero compact operator then there exists a non-trivial subspace invariant under 
all operators in TZ (T) . If X is a Banach space and A is an algebra in C {X) then A is called 
non-transitive if there exists a non-trivial subspace which is invariant under every element 
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of A. (If A = {T}' then A is non-transitive if and only if T has a non-trivial hyperinvariant 
subspace.) 

(B) In 1973 V. Lomonosov proved the following celebrated result: Let X be a complex 
Banach space and T be an operator on X which is not a multiple of the identity and commutes 
with some non-zero compact operator. Then T has a non-trivial hyper-invariant subspace. 
For the proof of this result, the new idea that was introduced was the Schauder fixed point 
Theorem: If $ is a norm-continuous function defined on a closed convex subset C of a normed 
space, and is contained in a norm-compact subset K of C, then $ has a fixed point. 
Lomonosov's result was extended to real Banach spaces by N.D. Hooker in 1981, j21j|. A 
special case of Lomonosov's Theorem with a short proof (still using the Schauder fixed point 
Theorem) was given by M. Hilden in 1977, pO] . 

A huge amount of literature has been produced towards extending Lomonosov's technique. 
One of the strongest results in this direction was proved by Lomonosov in 1991 (22]: Let X be 
a Banach space, ^ be a proper subalgebra of C (X), (i.e. Aj^C i^)) which is weakly closed. 
Then there exists x** G X**\{0} and x* G X*\{0} such that |a;**T*a;*| < |||T||| for all T G 
A, where |||T||| denotes the essential norm of T i.e. its distance from the space of compact 
operators. A corollary of this result is the following: Let X be a Banach space and A be 
a weakly closed proper subalgebra of C (X) such that there exists a net {Aa} C A and a 
non-zero operator A & A such that A* —>■ A* weakly and |||y4Q,||| 0. Then {T* : T G A} 
is non-transitive. This corollary is a generalization of W. Burnside's Theorem on matrix 
algebras: Every proper algebra of matrices over an algebraically closed field has a non-trivial 
invariant subspace. The shortest proof of Burnside's Theorem is given in |26j . 

In 1996 A. Simonic proved the following Hilbert space analogue of the 1991 Lomonosov's 
result jH]: Let if be a complex Hilbert space, and ^ be a weakly closed proper subalgebra 
of C{H). Then there exist x, y G -f/'\{0} such that |Re < Tx,y > \ < |||ReT||| < x,y > 
for all T G As a corollary he obtained that every essentially selfadjoint operator (i.e. 
T — T* is a compact operator) on an infinite dimensional real Hilbert space has a non-trivial 
invariant subspace. 

(C) Recall that a subnormal operator on a Hilbert space is the restriction of a normal 
operator to an invariant subspace. In 1978 S.W. Brown fT^ proved that every subnormal 
operator has a non-trivial invariant subspace. Functional Calculus was one of the main tools 
in the proof, which introduced the theory of dual algebras. For the developments on this 
theory see the book ^T] . One of the main results produced by the theory of dual algebras is 
the 1986 result of Brown, B. Chevreau and Pearcy ^3], that every contraction on the Hilbert 
space whose spectrum contains the unit circle has a non-trivial invariant subspace (also see 
[TU]). Recall that an operator T on a Hilbert space is called hyponormal if TT* < T*T. 
Every subnormal operator is hyponormal. In 1987 Brown proved |14 that every hyponormal 
operator T has a non-trivial invariant subspace whenever C{a{T)) ^ R{a{T)) where for a 
compact i^' C C, C{K) denotes the continuous functions on K and R{K) denotes the closure 
(in the C{K) norm) of the rational functions on K with poles outside of K). The main tools 
of the proof are the theory of dual algebras and a result of [31] on properties of hyponormal 
operators. 

(D) The technique of "extremal vectors" was introduced in 1998 by A. Ansari and P. 
Enflo 0. Let X be a reflexive Banach space, T be an operator on X with dense range, 
e G (0, 1), Xo G X, ||xo|| = 1. For every n G N let G T""{x G X : ||xo — < e} with 
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WUnW = inf{||y|| : y € T^"{s G X : ||xo — < e}}. Then (?/„) is called a sequence of extremal 
vectors of T with respect to e and Xq. If x is a weak limit point of {T^yn)n and T satisfies 
additional assumptions it turns out that x is hyper-non-cyclic for T (i.e. x is non-cyclic for 
all operators commuting with T). Using the technique of minimal vectors, a special case of 
the 1973 result of Lomonosov is proved in j3]: Let K he a. non-zero compact operator on a 
Hilbert space. Then K has a non-trivial hyper-invariant subspace. 

(E) An example of a Banach space that admits an operator without any non-trivial 
invariant subspace, (i.e. a transitive operator) was given by Enflo in the 70's, JEl, CZl- The 
technique was simplified in jH]. Further examples were given by C. Read, [3^1, [SZl, [SHI, EHI- 

3. The method of compatible sequences 

Along with the method of compatible sequences, a new topological ingredient will be 
used in this article in order to obtain non-trivial invariant subspaces of operators: selection 
theorems for set valued functions. Excellent references for this topic are jSU] and [221 • Let 
X and y be topological spaces, V iy) denote the power set of y and (p : X ^ V {y) be a 
set valued function. If 0(a;) 7^ for aX\ x E X then a function f : X ^y is called a selection 
of (p if f{x) e 0(x) for all X G A". The set valued function is called lower semi continuous 
(l.s.c.) if for any open subset V of y, the set {x E X : 0(x) fl 7^ 0} is open in X . In terms 
of convergence of nets, this definition is equivalent to: for all x G A", for all y G 0(x) and for 
all nets (xA)AeA ^ X with x\ x, obtain that there exists y\ G 0(xa) such that yx — > ?/. For 
the set valued map (j) denote by and conv0 (if the values of are subsets of a topological 
vector space) the maps defined by 

0(x) = the closure of the set 0(x); conv 0(x) = the closure of the convex hull of 0(x). 

Recall that a Hausdorff topological space X is called paracompact if every open covering of 
X has a locally finite refinement. Michael's selection Theorem, |28t Theorem 3.2"], states 
that a Hausdorff topological space X is paracompact if and only if for any Banach space y, 
every l.s.c. set valued function (p : X —>■ V (y) whose values are non-empty closed convex 
subsets of 3^ has a continuous selection. It should be mentioned that if one is interested in 
sufficient conditions for the existence of continuous selections of set valued functions, then 
the assumptions of the above result are not optimal. The assumption of lower semicontinuity 
can be weakened to "weak lower semicontinuity" as it was observed by K. Przeslawski and 
L. Rybinski (see [SSI fo'^ details). The assumption that 3^ is a Banach space can also be 
weakened. In fact in [2H] it was observed that the proof gives that y can be assumed to be 
an F space (i.e. a complete metrizable topological vector space). The metrizability of y is 
not necessary, since the result was further improved in [221 as follows: 

Theorem 3.1. Let X be a paracompact topological space, y be a locally convex topological 
vector space with the property that the closed convex hull of any compact set is compact, and 
(f) : X ^ V [y) be an l.s.c. map such that U{0(x) : x G X} is metrizable and 0(x) is a 
complete set for all x E X . Then the map convcj) admits a continuous selection. 

Now the technique of compatible sequences is presented. It is applied in order to obtain 
the following result which is a special case of the result of [Uj. 

Theorem 3.2. Every compact operator on a complex reflexive Banach space has a non-trivial 
invariant subspace. 
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Proof. Let X be a complex reflexive Banach space and T be a compact operator on X. It 
will be shown that T has a non-trivial invariant subspace. Without loss of generality assume 
that X is separable (else the closed linear span of the the orbit of any non-zero vector under 
T is a non-trivial invariant subspace of T). 

Claim 1: There exist sets A C X, B C X* and sequences {xn)n£N ^ A and C B 

satisfying 

(a) A is bounded and the origin does not belong to the weak closure of A. 

(b) B is bounded and the origin does not belong to the weak closure of B. 

(c) For all integers 1 < k < i < m, 

(4) Ixt.T'xel < -. 

m 

Once Claim 1 is established, the sequences and {x^)n are compatible, thus by Re- 

mark T has a non-trivial invariant subspace. This finishes the proof. It remains to prove 
Claim 1. 

The sets A and B that appear in (a) and (b) of Claim 1 are constructed as follows: The 
set A is any non-empty closed convex bounded subset of X which does not contain the origin 
and has a non-empty norm interior. Let Xq be a point in the norm-interior of A. Let 

B = {x* G X* : Rex*x > for all x G A and Rex*Xo = !}• 

Since A is convex, has non-empty norm-interior and does not contain the origin, by the 
Eidelheit separation theorem, B is non-empty. Obviously B is weakly closed. In order to 
see that B is bounded, fix x* G -B and notice that since xq belongs to the norm-interior of 
A, there exists e > such that xq — x E A for all x & X with ||x|| < e. Hence 

< Rex*(xo — x) = Rex*xo — Rex*x = 1 — Rex*x. 

Thus Rex*a; < 1 for all a; G X with ||a;|| < e, which proves that B is bounded. Hence B 
is weakly compact, and the sets A, B constructed above satisfy (a) and (b) of Claim 1. It 
remains to construct sequences {xn)n ^ A and (a;*)„ C B satisfying (c) of Claim 1. 

Claim 2: Either there exists a sequence {xn)nm ^ ^ such that for every m G N, 

mi 

5 n Pi G X* : \x*T^Xi\ < -} 7^ 0, 

i=l k=l ^ 

or T has an eigenvalue. 

Of course, if the first alternative of Claim 2 is valid then pick a sequence in X* 

with 

mi ^ 

X* G S n n PlK e X* : \x*T''xe\ < — } 
I I I I ^ 

i=l k=l 

and obviously {xn)neN and (x*)„gi^ satisfy (c) of Claim 1 and the proof finishes. Also, if the 
second alternative of Claim 2 is valid then the proof finishes as well. Thus it only remains 
to establish Claim 2. 

Assume that the first alternative of Claim 2 is false. It will be shown that the second 
alternative of Claim 2 is true. Since the first alternative of Claim 2 is false, for every 

6 



sequence {xn)neN ^ ^ there exists m G N such that 

mi ^ 

5 n n PlK e X* : \x*T''xA < -} = 0, 

I I I I 

e=i k=i 

or equivalently, 

mi ^ 

(5) B C[j[j{x* eX* ■.\x*T''xe\>-}. 

i=l k=l ^ 

For {Xn)n ^ A and m G N define 

(6) Y{{xn)n=i) ■= Span {T'^x^ : for £ G {1, . . . , m} and A; G {1, . . . , i}}. 

Claim 3: Let any sequence {xn)neN ^ A and pick m G N for which ((H)) is vahd. Then 
^((^n)™=i) n y4° 7^ 0, where ^4° denotes the norm-interior of A. 

Indeed, let {xn)neN C A and m G N for which ® is vahd. If Y{{xn)n=i) n A" = 0, 
then since Y{{xn)^=i) ^° convex sets and A° is non-empty open, by the Eidelheit 
separation theorem there exists x* G X* such that the restriction of x* on Y (XX'n)'^=\) is 
equal to zero, (since is a linear space), Rex*x > for all x E A, and Rex*x > 

for all X G A". In particular, Rea;*xo > 0. Let y* = x* /Rex*xo. Then y* G -B. Hence 
(0) implies that there exists i E {1, . . . ,m} and G {1, . . .^} such that |?/*T^x^| > ^. In 
particular, y*T^X(, ^ which contradicts the fact that the restriction of y* on Y {{xn)^=i) is 
equal to zero, and finishes the proof of Claim 3. 

Define a function m : — > N as follows: For {xn)n&i G 

let 

mi ^ 

(7) m((a;n)neN) = min{m G N : 5 C |J |J{a;* G X* : \x*T^Xt\ > —}}. 

TJX 

i=l k=l 

Define a set valued function $ : A^ V (X) by 

(8) ^{{Xn)nm) = y{{Xn)n=l) ^ A° whcrC /i = m{{x n) n^) ■ 

In the proof of Claim 2 the following has been achieved so far: 

// the first alternative of Claim 2 is false then the set valued function $ defined in (0j has 
the property that $((a;„)n) is a non-empty convex set for all G A^; (the fact that for 

every {xn)n ^ A^ , ^{.{.Xn)n) is a non-empty set, is exactly the statement of Claim 3; the fact 
that is a convex set is obvious). 

For the remaining of the proof, endow X (and thus A) with the weak topology and X^ 
(and thus Al^) with the product topology of the weak topology. Then, since X is refiexive, 
A and are compact topological spaces. 

Claim 4: The function $ defined in (jH)) is l.s.c. 

Assume for the moment that Claim 4 has been shown. Now observe that the assumptions 
of Theorem 13.11 are satisfied for $: Indeed AP' is a compact Hausdorff space (hence it is 
paracompact). Since X is separable refiexive and A is bounded, the weak topology on A is 
metrizable. Thus by Theorem 13. II there exists a continuous selection F : AP' ^ X of $. For 
every (x„)„ G A^ , if /i = m((x„)„) then 

'^{{Xn)nen) <^ AnY{{XnTn=l). 
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Hence F((a;„)„) G A for all (a;„)„ G A^. Define 

G : ^ by ^((xOn) = (F((a:„)„), . . .)• 

Obviously G is continuous since F is continuous. Since is a convex compact subset of the 
topological vector space (endowed with the product topology of the weak topology of 
X), by the Brouwer-Schauder-Tychonov's Theorem, (see for instance |H Corollary 16.52]), 
G has a fixed point. If (x„)„ G is a fixed point of G then F{{xn)nm) = Xi = X2 = 
Thus there exists x E A such that F((x„)„) = x where Xn = x for all n G N. If 
/X = m((a;„)„) then by the definition of Y{{xn)n=i), F'{{xn)n) is a finite linear combination of 
the vectors {T'^x : k = 1, . . . Thus there exists a non-constant polynomial q such that 
F{{xn)n) = q{T)x. Hence q{T)x = x, i.e. 1 G ap{q(T)). Since X is a complex Banach space, 
by the Fundamental Theorem of Algebra, ap{q(T)) = q{ap(T)) hence o"p(T) 7^ 0, thus T has 
a non-zero eigenvector which spans a non-trivial invariant subspace of T. Hence the second 
alternative of Claim 2 was shown to be true. It only remains to establish Claim 4. 

The proof of Claim 4 is based on the fact that the function m : Al^ — > N is an l.s.c. function. 
In order to see that m is an l.s.c. function, let {{xj^n)nm)jm ^ aiid {xn)nen ^ such 
that {xj^n)nm —> {.Xn)n&n as j 00, i.e. 

(9) Xjj^ — > X£ weakly as j 00, for all £ G N. 

Let /i := m((x*)„gN) and for j G N, let /ij := 'm{{x*^^nm) as defined by ((Tj). It is claimed 
that /ij > /i for all j large enough (which will finish the proof that the function m is an l.s.c. 
function). Indeed, if /ij < /i — 1 for infinitely many j's, then by passing to a subsequence and 
relabeling assume that there exists a constant fj^o < fi ~ 1 such that fij = fio for all j G N. 
Thus by ©, 

MO e 

(10) 5 C y |J{x* G X* : |x*T^Xj-£| > — } for all j G N, 



e=i k=i 

yet 

MO i 



1^0 



11) B <^[j[j{x* eX* ■.\x*T''xe\>—}. 



e=i k=i 

By (jlip there exists b E B such that 

\bT''xe\ < — for all £ = 1, . . . , /io and k = 1, . . . ,£. 
Then by ^ there exists j large enough such that 
(12) \bT''xj,i\ < — for all £ = 1, . . . , /io and = 1, . . . , 

But (1121) contradicts (fTUI) . The contradiction proves that /Xj > for all j large enough, and 

by passing to a subsequence and relabeling, assume that fij > jj, for all j G N. 

The proof of Claim 4 continues as follows: Let {{xj^n)nm)jen ^ ^ and (x„)„gN £ 

satisfying ©, /i := m{{xn)n&{), /^i := m((xj-„)neN) (for j G N), and y G $((x„)„eN)- By (0) 
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and (jHI) there exist {ak/)^Ji i^^i C C such that 

^l e 

y = a-k/T'^xe. 
e=i k=i 

For j en let Yj := Y{{xj^n)n=i) as defined in ©, and 

i=l k=l 

Then, for all j's large enough, yUj > /i (since the function m is an l.s.c. function), and thus 
Uj G Yj. By © and the compactness of T obtain that Uj — >■ y in norm. Thus ?/j G v4° (since 
?/ G A°) and hence ?/j G A° and ?/j G $((a;j,n)neN) for all j's large enough. Since yj y 
weakly as j oo, the set valued function $ is l.s.c. which finishes the proof of Claim 4. □ 

Notice that in the proof of Theorem \'S.2\ the compactness of the operator T was only used 
in the third line before the end of proof. Thus the compactness of T was used to show that 
the map $ defined in (jHI) is l.s.c. In fact in the third line before the end of the proof of 
Theorem 13.21 it is obtained that "?/-, —>■ y in norm" which implies that the function $ is l.s.c. 
even if the range space is equipped with the norm topology (while still the domain is equipped 
with the product of the weak topology). Note that for the proof of Theorem 13.21 to work, it 
is only required that $ is l.s.c. when the range space is equipped with the weak topology. 
Thus it is reasonable to ask whether the assumption of the compactness of the operator in 
the above proof can be omitted, or replaced by a weaker assumption. 

In the proof of Theorem 13.21 under the assumption of the compactness of the operator T, 
the use of the selection Theorem 13.11 was not necessary. Alternatively A can be taken to be a 
closed strictly convex ball of X which does not contain the origin (without loss of generality 
X can be renormed to be strictly convex) and it can be shown that the function F : A^ A 
defined by F{{xn)n) to be the unique point of An Y{{xn)^=i"^"^) of ^^e smallest norm, is a 
continuous selection of $. This choice of a continuous selection is motivated by and [Hj. 

Another application of the method of compatible sequences is the following: 

Theorem 3.3. Let X be a reflexive Banach space, T G jC{X), and A be any closed ball 
of X . Then either there exists v e A such that Tv = 0, or there exists v E A such that 
Span OrbTiTv) is a non-trivial invariant subspace ofT, or A C Span{T^Xi : i eN,l < k < 
i} for every {xn)nm e A^. 

Notice that if X is a Banach space and T G C{X) which does not have any non-trivial 
invariant subspace then for any x G X\{0}, the span of the set {T''x : A; G N} is dense 
in X. Thus Theorem 13.31 is a localized version of the following obvious observation: Every 
T G C{X) either has a non-trivial invariant subspace or for every x G X\{0} the span of the 
set {T^x : k G N} is dense in X. 

Proof of Theorem VJ.'^ Let X be a reflexive Banach space and T be an operator on X. Let A 
be any closed ball in X. If A contains the origin then the first alternative of Theorem 13.31 is 
valid, thus assume that A does not contain the origin. Let A° denote the norm-interior of A. 
Fix a weakly open neighborhood V of the origin of X. Observe that since {y + V : y E A°} 
is a weakly open cover of the weakly compact set A (by the refiexivity of X, A is weakly 
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compact; note also that A° is dense in A), there exists a positive integer n{V) and a finite 
set {a{V, 1), a{V, 2), . . . , a{V, n{V))} C A° such that U{a(y, i) + V : i = 1, . . . , n{V)} 3 A 
Define 

B{V) = {x* e X* : there exists I <i < n{V) such that 

Rex*x > for all x E An {a{V,i) + V), and Rex*a{V,i) = 1}. 

Since A fl {a{V,i) + V") is convex, has non-empty norm-interior and does not contain the 
origin, by the Eidelheit separation theorem, B{V) is non-empty. Obviously B{V) is weakly 
closed. In order to see that B{V) is bounded, notice that since a{V,i) belongs to the 
norm-interior of A (1 {a{V,i) + V") for all 1 < i < n{V), there exists e > such that 
a{V, i) — X E An {a{V, i) + V") for all 1 < z < niV) whenever x E X with < e. Now let 
X* e B{V). There exists I <i < n{V) such that Rex*x > for all x G A n (a(V,i) + V) 
and Rex*a(V,i) = 1. Hence for x G X with < e, 

< Rea;*(a(V, i) — x) = Rex*a(V, i) — Rex*x = 1 — Rex*x. 

Thus Rea;*x < 1 for all a; G X with ||x|| < £, which proves that BiV) is bounded. The proof 
continues by separating two cases: 

Case 1: There exists a symmetric convex weakly open neighborhood V of the origin in X 
and sequences {xn)nm ^ ^ and {x*^nm ^ B{y) satisfying 

(13) \x* T^xA < — for all integers 1 < k < i < m. 

m 

Then, since A, B{y) are bounded, weakly closed and do not contain the origin, the 
sequences (x„)„ and (a;*)„ are compatible and the proof of Remark 11.21 gives that there 
exists V E A such that either Tv = or Span OrbT(Tf ) is a non-trivial invariant subspace 
of T. 

Case 2: For every weakly open symmetric convex neighborhood V of the origin of X and 
for every sequence {xn)nm ^ there exists m G N such that 

ml _ 

BiV) n Pi G X* : \x*T^x^\ < -} = 0. 

£=1 fc=l ^ 

Of course the last relationship implies that 

ml ^ 

(14) B{V) C y |J{x* G X* : \x*T^Xi\ > -}. 

1=1 k=l ^ 

For any (a;„)„ G A^ let Z{{xn)n) denote the closed linear span of the set {T^x^ : for £ G 
N and 1 < A; < £}. 

Claim 5: For every (x„)„ G A^, the set Z((x„)„) is dense in A. 

Claim 5 implies the third alternative of Theorem 13.31 and finishes the proof. In order 
to prove Claim 5, note that since for every {xn)n £ A^, the set Z{{xn)n) H A is convex, 
it is equivalent to prove that Z{{xn)n) is weakly dense in A. Thus is enough to prove 
that for every y E A, weakly open neighborhood V of the origin of X, and {xn)n ^ A^, 
Z{ixn)n) n A n (y + V) ^ 0. To see this, notice that if Z((x„)„) n {A" n {y + V)) = 0, then, 
since Z((x„)„) and A" r\{y + V) are convex sets and A° r\{y + V) is a non-empty norm-open 
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set (since A° is dense in A), by the Eidelheit separation theorem there exists x* G X* such 
that the restriction of x* on Z{{xn)n) is equal to zero, Rex*x > for all x G An (y + V), and 
Rex*x > for all x G A°r\{y + V). Let V be a weakly open convex symmetric neighborhood 
of the origin of X such that V + V C V. Since A C U{a(\/',i) + V"' : 1 < i < n{V')}, 
there exists 1 < i < n(V^') such that y G a(V^', i) + V. Thus a(V"', i) E y + V, hence 
A n {a{V',i) + V') C A n {y + V + V) C A n {y + V). Therefore Rex*x > for all 
X e An {a{V',i) + V). Since a{V',i) e A° n {a{V',i) + V) C A° n {y + V), obtain that 
Rex*a{V',i) > 0. Let y* = x* /Rex*a{V' Then y* G B{V'). Hence (HH) implies that 
there exists mGN, £g{1,..., m} and k G {!,...£} such that \y*T''Xi\ > ^. In particular, 
y*T^Xi 7^ which contradicts the fact that the restriction of y* on Z{{xn)n) is equal to zero, 
and finishes the proof of Claim 5. □ 

If X is reflexive, T E C (X) and the third alternative of the statement of Theorem 13.31 is 
valid for every closed ball A of X, does T have a non-trivial invariant subspace? 

Remark 3.4. The proof of Theorem \3. ^ works if A is a more general set than a closed ball. 
In fact A can be taken to be any weakly compact convex subset of X with non-empty norm 
interior. For such set A it is not hard to see that A° is dense in A, which was used in the 
proof. 

Immediate consequence of Theorem 13.31 is the following: 

Corollary 3.5. Let X be a reflexive Banach space, T G C{X), and A be any closed ball 
of X . Then either there exists v E A such that Tv = 0, or there exists v E A such that 
Span OrbxiTv) is a non-trivial invariant subspace ofT, or A C Span{T^v : k eN} for every 
V E A. 
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